Alternative Approaches to Evaluation in Empirical Microeconomics

This paper reviews some of the most popular policy evaluation methods in empirical microeconomics: social experiments, natural experiments, matching, instrumental variables, discontinuity design, and control functions. It discusses identification of traditionally used average parameters and more complex distributional parameters. The adequacy, assumptions, and data requirements of each approach are discussed drawing on empirical evidence from the education and employment policy evaluation literature. A workhorse simulation model of education returns is used throughout the paper to discuss and illustrate each approach. The full set of STATA datasets and do-files are available free online and can be used to reproduce all estimation and simulation results.evaluation methods

Alternative approaches to evaluation in empirical microeconomics

This paper reviews a range of the most popular policy evaluation methods in empirical microeconomics: social experiments, natural experiments, matching methods, instrumental variables, discontinuity design and control functions. It discusses the identification of both the traditionally used average parameters and more complex distributional parameters. In each case, the necessary assumptions and the data requirements are considered. The adequacy of each approach is discussed drawing on the empirical evidence from the education and labor market policy evaluation literature. We also develop an education evaluation model which we use to carry through the discussion of each alternative approach. A full set of STATA datasets are provided free online which contain Monte-Carlo replications of the various specifications of the education evaluation model. There are also a full set of STATA .do files for each of the estimation approaches described in the paper. The .do-files can be used together with the datasets to reproduce all the results in the paper.

Alternative approaches to evaluation in empirical microeconomics

Four alternative but related approaches to empirical evaluation of policy interventions are studied: social experiments, natural experiments, matching methods, and instrumental variables. In each case the necessary assumptions and the data requirements are considered for estimation of a number of key parameters of interest. These key parameters include the average treatment effect, the treatment of the treated and the local average treatment effect. Some issues of implementation and interpretation are discussed drawing on the labour market programme evaluation literature.

Alternative approaches to evaluation in empirical microeconomics

The research is part of the program of the ESRC Centre for the Microeconomic Analysis of Fiscal Policy at IFS. Financial support from the ESRC is gratefully acknowledged. The second author also acknowledges the financial support from Sub-Programa Cieˆncia e Tecnologia do Segundo Quadro Comunita´rio de Apoio, grant number PRAXIS XXI/BD/11413/97.Four alternative but related approaches to empirical evaluation of policy interventions are studied: social experiments, natural experiments, matching methods, and instrumental variables. In each case the necessary assumptions and the data requirements are considered for estimation of a number of key parameters of interest. These key parameters include the average treatment effect, the treatment on the treated and the local average treatment effect. Some issues of implemen- tation and interpretation are discussed drawing on the labour market programme evaluation literature.info:eu-repo/semantics/publishedVersio

The long-term effects of in-work benefits in a life-cycle model for policy evaluation

This paper presents a life-cycle model of woman's labour supply, human capital formation and savings for the evaluation of welfare-to-work and tax policies. Women's decisions are formalised in a dynamic and uncertain environment. The model includes a detailed characterisation of the tax system and of the dynamics of family formation while explicitly considering the determinants of employment and education decisions: (i ) contemporaneous incentives to work, (ii ) future consequences for employment through human capital accumulation and (iii) anticipatory effects on the value of employment and education. The choice of parameters follows a careful calibration procedure, based of a large sample of data moments from the British population during the nineties using BHPS data. Many important features established in the empirical literature are reproduced in the simulation exercises, including the employment effects of the WFTC reform in the UK. The model is used to gain further insight into the responses to two recent policy changes, the October 1999 WFTC and the April 2003 WTC/CTC reforms. We find small but non-negligible anticipation effects on employment and education.

The matching method for treatment evaluation with selective participation and ineligibles

The matching method for treatment evaluation does not balance selective unobserved differences between treated and non-treated. We derive a simple correction term if there is an instrument that shifts the treatment probability to zero in specific cases. Policies with eligibility restrictions,where treatment is impossible if some variable exceeds a certain value, provide a natural application. In an empirical analysis, we first examine the performance of matching versus regression-discontinuity estimation in the sharp age-discontinuity design of the NDYP job search assistance program for young unemployed in the UK. Next, we exploit the age eligibility restriction in the Swedish Youth Practice subsidized work program for young unemployed, where compliance is imperfect among the young. Adjusting the matching estimator for selectivity changes the results towards ineffectiveness of subsidized work in moving individuals into employment.

The matching method for treatment evaluation with selective participation and ineligibles

The matching method for treatment evaluation does not balance selective unobserved differences between treated and non-treated. We derive a simple correction term if there is an instrument that shifts the treatment probability to zero in specific cases. Within the same framework we also suggest a new test of the conditional independence assumption justifying matching. Policies with eligibility restrictions, where treatment is impossible if some variable exceeds a certain value, provide a natural application. In an empirical analysis, we exploit the age eligibility restriction in the Swedish Youth Practice subsidized work program for young unemployed, where compliance is imperfect among the young. Adjusting the matching estimator for selectivity changes the results towards making of subsidized work detrimental in moving individuals into employment.

The Matching Method for Treatment Evaluation with Selective Participation and Ineligibles

The matching method for treatment evaluation does not balance selective unobserved differences between treated and non-treated. We derive a simple correction term if there is an instrument that shifts the treatment probability to zero in specific cases. Policies with eligibility restrictions, where treatment is impossible if some variable exceeds a certain value, provide a natural application. In an empirical analysis, we first examine the performance of matching versus regression-discontinuity estimation in the sharp age-discontinuity design of the NDYP job search assistance program for young unemployed in the UK. Next, we exploit the age eligibility restriction in the Swedish Youth Practice subsidized work program for young unemployed, where compliance is imperfect among the young. Adjusting the matching estimator for selectivity changes the results towards ineffectiveness of subsidized work in moving individuals into employment.job search assistance, selection, regression discontinuity, treatment effect, policy evaluation, propensity score, subsidized work, youth unemployment

Evaluating the employment impact of a mandatory job search assistance program

This paper is an evaluation of the British labor market program the "New Deal for the Young Unemployed" using administrative panel data on individuals between 1982 and 1999. This mandatory program involves extensive job assistance followed by various other options, including wage subsidies. We exploit the differential timing of the introduction of the program across regions as well as age-related eligibility rules to identify the program effect. Estimates of the employment effects of the mandatory job search assistance part of the program are presented using a variety of estimation techniques exploring combined "difference in differences" and matching procedures. Our key finding is that unemployed men are now 20% more likely to gain jobs than prior to the New Deal.